Voice control system for ophthalmic laser systems

ABSTRACT

A voice control system for ophthalmologic laser treatment systems sets parameters for delivering laser energy based on voice commands and prevents potentially harmful parameters due to operator mistakes and misunderstood voice commands by providing incremental parameter adjustment and restricting the amount by which the parameters can be adjusted for each executed voice command. Valid voice commands include indications of which parameter to set, a value for the parameter, and whether to increase or decrease the value of the parameter. In one example, parameter values can only be increased or decreased by a certain percentage with respect to the current value. In another example, the parameters are adjusted by selecting the next highest or lowest value with respect to the current parameter value from a predetermined sequence of possible values for particular parameters. Voice control functionality can also be deactivated under certain conditions such as when it is determined that a parameter was not set.

RELATED APPLICATIONS

This application is a Continuation-in-Part of International PatentApplication No. PCT/EP2018/052896, filed on Feb. 6, 2018, whichdesignates the United States. International Application No.PCT/EP2018/052896, in turn, claims the benefit under 35 U.S.C. § 119(e)of U.S. Provisional Application No. 62/456,829, filed on Feb. 9, 2017,and further claims priority to Danish Patent Application No.PA201770679, filed on Sep. 11, 2017, all of which are incorporatedherein by reference in their entirety.

BACKGROUND OF THE INVENTION

There are a number of treatment regimes that involve delivering laserenergy to a patient's eye. In these treatments, doctors regularly setand update parameters dictating the laser energy to be delivered. Theseparameters can include peak power, pulse duration, and repeat interval,among other examples.

Commonly, slit lamps are used for delivering the laser energy to thepatient's eye. In these systems, the patients sit up in an examinationchair, rest their chin on a chin rest, and place their forehead againsta forehead band, both of which keep the patient's head in place duringthe procedure.

Another common device is a Laser Indirect Ophthalmoscope (LIO), which isa head mounted device, worn by the doctor to deliver laser energy into apatient's eye. Current systems use a laser console for generating thelaser light and a long fiber optic umbilical coupled to the LIO. Thelaser console includes a laser source, a power source (for example,providing AC/DC conversion), laser drive and parameter control systems,and a user interface. The user interface comprises physical knobs andswitches or a touchscreen and can be part of the laser console itself ora remote control device that communicates with the laser console.Activation devices (e.g. footswitches) connect to the laser consoles andactivate the laser emission, for example, by sending an activationsignal to the laser console in response to engagement of an activationmechanism (e.g. compression of the footswitch).

During procedures using the LIO, the doctor moves the laser console,which is positioned on a cart or table, to be in the proximity of thepatient who is usually in a supine position. The doctor then walksaround the patient to deliver the laser energy to the desired portionsof the retina. If a parameter change is needed, the doctor physicallyreturns to the laser console to make the change or has an assistant, forexample, standing next to the laser console, make the change.

SUMMARY OF THE INVENTION

The present invention includes a voice control system for ophthalmologiclaser treatment systems that is robust against operator mistakes andmisunderstood commands, for example, by replaying and confirming voicecommands, evaluating desired parameters against a predetermined safetypolicy, and providing incremental parameter adjustment and restrictingthe amount by which the parameters can be increased and/or decreased foreach executed voice command. The voice control system includes a voicecontrol module for recognizing spoken commands and a parameterregulation module for generating parameter information based on thespoken commands and a predetermined safety policy. Audible feedback ofcurrent and updated parameters is also provided.

In one example, a microphone first detects a wake word (which is aspecial phrase to indicate that verbal commands follow). The wake wordprovides a two-step recognition requirement for voice commands in orderto make a parameter change, decreasing the likelihood of an erroneousparameter change. In one embodiment, a tone is played after the wakeword is detected to prompt the user to provide the voice command.

In response to detecting the wake word, and after the tone is played,the microphone captures audio data, and the voice control modulerecognizes in the audio data a spoken command (in any multitude oflanguages) from a predetermined set of commands. The parameterregulation module then generates the parameter information based onwhich commands and other spoken information were recognized by the voicecontrol module.

In one example, the parameter regulation module only increases the powerand duration set points by 20% or less of the current set points, andthe valid voice commands are limited to indicating which parameter toadjust and whether to adjust the parameter up or down. These voicecommands can include “Power up,” “Power down,” “Duration up,” “Durationdown,” “Interval up,” “Interval down,” “Aiming beam up,” and “Aimingbeam down,” to list a few examples. The amount by which the parameterscan be increased or decreased can be restricted based on multipleconsiderations, including, for example, a prescribed tolerance band forset parameters according to industry regulations.

Additionally, the voice control functionality can be selectivelyexecuted under certain conditions to further enhance the safety of thelaser treatment system. In one example, voice commands to change theinterval parameter are not executed when it is determined that the userhad not previously specified a repeat interval for the current lasertreatment session.

In general, according to one aspect, the invention features a system fordelivering laser energy to an eye of a patient comprising a microphone,a voice control module, an parameter regulation module, and a controlmodule. The microphone captures audio data. The voice control modulereceives the captured audio data and generates voice command informationbased on the captured audio data. The parameter regulation modulegenerates parameter information based on the voice command information.The control module receives the parameter information and sets theparameters for the delivered laser energy based on the parameterinformation.

In embodiments, the voice control module generates the voice commandinformation by recognizing spoken language in the captured audio data,which can indicate the parameters to be adjusted, values for theparameters and/or whether values for the parameters should be increasedor decreased. The microphone captures the audio data in response todetecting a predetermined wake word, and audible feedback confirming theparameter information and/or the voice command information is providedvia speakers. Both the voice control module and the parameter regulationmodule can execute on a mobile computing device of a body-mountedlaser-indirect ophthalmoscope system, a laser console of alaser-indirect ophthalmoscope system, and/or a user terminal of anophthalmic laser treatment system. The parameter regulation modulegenerates the parameter information based on current values for theparameters to be set and/or a predetermined safety policy, which canindicate maximum values and/or percentages by which the parameters canbe increased and/or decreased, predetermined sequences of possiblevalues for the parameters, whether setting of parameters in response tovoice commands is selectively executed based on the current parameters,and/or other criteria indicating that the parameters are potentiallyunsafe.

In general, according to another aspect, the invention features a methodfor delivering laser energy to an eye of a patient using an ophthalmiclaser treatment system. Audio data is captured, and voice commandinformation based on the captured audio data is generated. Parameterinformation is then generated based on the voice command information.The parameters for the delivered laser energy are set based on theparameter information.

The above and other features of the invention including various noveldetails of construction and combinations of parts, and other advantages,will now be more particularly described with reference to theaccompanying drawings and pointed out in the claims. It will beunderstood that the particular method and device embodying the inventionare shown by way of illustration and not as a limitation of theinvention. The principles and features of this invention may be employedin various and numerous embodiments without departing from the scope ofthe invention.

BRIEF DESCRIPTION OF THE DRAWINGS

In the accompanying drawings, reference characters refer to the sameparts throughout the different views. The drawings are not necessarilyto scale; emphasis has instead been placed upon illustrating theprinciples of the invention. Of the drawings:

FIG. 1 is a schematic illustration of an exemplary body-mountedlaser-indirect ophthalmoscope (LIO) system to which the presentinvention is applicable;

FIG. 2 is a block diagram of the body-mounted LIO system according tothe present invention;

FIG. 3 is a schematic illustration of an exemplary table-top LIO systemto which the present invention is also applicable;

FIG. 4 is a block diagram of the table-top LIO system according to thepresent invention;

FIG. 5 is a schematic side cross-sectional view of an exemplary slitlamp system to which the present invention is also applicable;

FIG. 6 is a block diagram of the slit lamp system according to thepresent invention;

FIG. 7 is a sequence diagram illustrating the process by whichparameters for delivered laser energy are set based on captured audiodata according to the present invention; and

FIG. 8 is a flow diagram illustrating the process by which the parameterregulation module generates parameter information based on voice commandinformation and a predetermined safety policy.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The invention now will be described more fully hereinafter withreference to the accompanying drawings, in which illustrativeembodiments of the invention are shown. This invention may, however, beembodied in many different forms and should not be construed as limitedto the embodiments set forth herein; rather, these embodiments areprovided so that this disclosure will be thorough and complete, and willfully convey the scope of the invention to those skilled in the art.

As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items. Further, the singular formsand the articles “a”, “an” and “the” are intended to include the pluralforms as well, unless expressly stated otherwise. It will be furtherunderstood that the terms: includes, comprises, including and/orcomprising, when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof. Further, it will be understood that when anelement, including component or subsystem, is referred to and/or shownas being connected or coupled to another element, it can be directlyconnected or coupled to the other element or intervening elements may bepresent.

The present invention concerns a voice control system for differentophthalmic laser treatment devices. In general, FIGS. 1-6 concernexemplary ophthalmic laser treatment systems that have been augmentedaccording to the present invention.

FIG. 1 is an illustration of a body-mounted LIO system 100-1. Ingeneral, the body-mounted LIO system 100 delivers laser energy to an eyeof a patient. A user of the LIO system 100-1 is typically a doctor suchas an ophthalmologist.

The body-mounted LIO system 100-1 includes a binocular indirectophthalmoscope 120, a control module 108, a power module 110, a lasermodule 112 and a mobile computing device 104.

The binocular indirect ophthalmoscope 120 is an optical device forexamining the inside of the eye of the patient. The binocular indirectophthalmoscope 120 includes an illumination unit 114 for providing whitelight and an optical system including a viewing aperture 118 and an exitaperture 116 from which the laser energy is emitted (which is also anentrance aperture for image information e.g. for viewing the patient'seye).

In general, the power module 110 provides power to the control module108 and the laser module 112. In one embodiment, the power module 110also provides power to the illumination unit 114 of the binocularindirect ophthalmoscope 120.

The laser module 112 produces and emits the pulsed laser energyaccording to certain user-provided parameters such as pulse envelopeduration, peak power, and micropulse duration and interval, among otherexamples.

The activation device 106, which is part of the user interface of thebody-mounted LIO system 100-1, is a device that receives user input viaan activation mechanism (e.g. a switch or button) and in response sendsactivation signals to the control module 108 indicating that the laserenergy should be emitted. The activation device 106 is typically afootswitch, and engagement with the activation mechanism includescompression of the footswitch by the user's foot, for example.

Preferably, the mobile computing device 120 is a tablet computer.Alternatively, the mobile computing device 120 could be a smartphonedevice, laptop computer, or phablet computer (i.e., a mobile device thatis typically larger than a smart phone, but smaller than a tablet), tolist a few examples. In general, the mobile computing device 104provides additional components of the user interface and generatesparameter information indicating the user-provided parameters based oninput received via the user interface and sends the parameterinformation to the control module 108.

In the illustrated example, the user interface further includes a voicecontrol interface that allows the user to indicate parameter informationusing verbal commands. In one example, the user provides a verbalcommand (e.g. “Power 200”, “Power up”), and the mobile computing deviceprovides audible feedback confirming the command, for example, bycalling out the parameter being adjusted. In one example, if the “power”is currently set at 200, and a voice command of “Power up” is given, theaudible feedback calls out the name of the parameter and the nexthighest increment from the starting point (e.g. “Power at 225”).

The control module 108 controls the laser energy delivered by the lasermodule 112 based on parameter information received from the mobilecomputing device 104 and activation signals received from the activationdevice 106. In the illustrated example, the control module 108communicates with the activation device 106 and the mobile computingdevice 104 wirelessly. In response to receiving the parameterinformation from the mobile computing device 104, the control module 108sets the parameters for the laser energy. In response to receivingactivation signals from the activation device 106, the control module108 sends control signals reflecting the user-provided parameters to thelaser module 112 activating the laser module and causing it to produceand/or emit the laser energy.

The body-mounted LIO system 100-1 includes a wearable assembly 102,which secures the body-mounted LIO system 100-1 to the user's body viaone or more wearable objects such as a headset, a utility belt, or abackpack, among other examples. In the illustrated example, the wearableassembly 102 comprises only a headset 102-1, which is worn on the user'shead.

FIG. 2 is a block diagram of the body-mounted LIO system 100-1 accordingto the preferred embodiment showing the components of the system in moredetail. Specifically, internal components of the headset 102-1, theactivation device 106, and the mobile computing device 104 are shown.

The mobile computing device 104 includes a central processing unit (CPU)222, a touchscreen display 230, a wireless interface 222 and antenna218, a microphone 234 and speakers 236.

The CPU 222 executes firmware/operating system instructions and sendsinstructions and data to and receives data from the wireless interface220, the microphone 234, the speakers 236, and the display 230.Executing on typically an operating system (OS) 224 of the CPU 222 are amobile application 226, a voice control module 228, and an parameterregulation module 229. The mobile application 226 renders a graphicaluser interface (GUI) 232 on the touchscreen display 230. The GUI 232,which is part of the user interface of the body-mounted LIO system100-1, displays and receives information such as parameter information,for example, by detecting contact between the user and the touchscreendisplay 230 in certain regions of the touchscreen display 230. Themobile application 226 also performs functions related to configuringthe LIO system 100 such as pairing the mobile computing device 104 withthe control module 108 and/or setting a wake word, which is a selectedphrase for indicating that verbal commands follow.

The microphone 234 captures sound including the wake word and voicecommands indicating parameter information provided by the user, whichthe mobile computing device 104 converts to audio data.

The speakers 236 produce sound based on instructions from the parameterregulation module 229, for example, in order to provide audible feedbackconfirming parameter information and/or voice commands.

The voice control module 228 generates voice command information basedon the captured audio data. In one example, the voice control module 228recognizes spoken language in the audio data and translates the spokenlanguage to commands that can be interpreted by the parameter regulationmodule 229 and/or executed by the control module 108.

The parameter regulation module 229 generates parameter informationbased on the voice command information generated by the voice controlmodule 228, current parameters for delivering the laser energy, and/or apredetermined safety policy. In generating the parameter information,the parameter regulation module 229 also controls and limits the abilityof voice commands generated by the voice control module to enact changesto the parameters for the delivered laser energy.

The parameter regulation module 229 maintains a set of voice commandsthat are recognized and translated to parameter information. These validvoice commands might include indicating which parameter to set or adjustand what value to set for the parameter or whether to adjust theparameter up or down in order to provide incremental voice commandfunctionality. These voice commands can include “Power 200,” “Power up,”“Power down,” “Duration up,” “Duration down,” “Interval up,” “Intervaldown,” “Aiming beam up,” “Aiming beam down,” “Pulse duration up,” “Pulseduration down,” to list a few examples.

The parameter regulation module 229 further provides the audiblefeedback confirming the voice command information and/or parameterinformation by sending instructions to the speakers 236 to producesound, for example, repeating back the voice commands interpreted by theparameter regulation module 229 and/or parameter information.Additionally, the parameter regulation module 229 evaluates thegenerated parameter information against a predetermined safety policy(for example, based on predetermined criteria in the safety policy fordetermining when parameters are potentially unsafe) and seeks extraconfirmation of the voice command information and/or the parameterinformation if the parameter information is determined to be unsafebased on the safety policy.

In one example, the parameter regulation module 229 provides audiblefeedback repeating the voice command and then waits for input from theuser interface (e.g. further voice command information generated by thevoice control module 228 based on sound detected by the microphone 234)before proceeding to generate the parameter information.

In another example, the parameter regulation module 229 determines thatthe parameters indicated by the parameter information generated based onthe voice command information are unsafe and alerts the user (e.g. viasound produced by the speakers 236) that the parameters are unsafeand/or requires extra confirmation from the user (e.g. via soundcaptured by the microphone 234) before proceeding to send the parameterinformation to the control module 108.

Additionally, in some embodiments, the parameter regulation module 229generates the parameter information, for example, by increasing ordecreasing current parameter values by predetermined values orpercentages. In one example, the parameter regulation module 229calculates an adjusted parameter value that is no more than apredetermined percentage of the current value. The predeterminedpercentage for setting the power parameter might be 20%, meaning thatthe power parameter can only be increased and/or decreased by 20% of thecurrent value in response to voice commands. Similarly, the voicecommands “aiming beam up” or “aiming beam down” results in no greaterthan a 10% change in intensity.

In some embodiments, the parameter regulation module 229 iteratesthrough sequences of predetermined values for particular parameters,selecting from the predetermined sequence a value that is higher orlower than the current parameter value in response to the voice commandinformation. For example, a finite set of all possible power settingsindicated by the predetermined safety policy might include 50, 60, 70,80, 90, 100, 110, 120, 130, 140, 150, 175, 200, 225, 250, 275, 300, 325,350, 375, 400, 425, 450, 475, 500 milliwatts (mW), continuing in 50 mWincrements to 1500 mW. If the current power setting is at 100 mW, theparameter regulation module 229 would generate parameter informationindicating that the parameters should be set to 110 mW in response tothe voice command “power up” and 90 mW in response to the voice command“power down.” In this way, the parameter regulation module 229 preventsthe parameters from being inadvertently adjusted from 100 mW to 1500 mW,for example, in response to a misspoken or misunderstood voice command.In a similar example, a finite set of all possible duration settingsindicated by the predetermined adjustment criteria might include 10, 11,12, 13, 14, 15, 17, 20, 22, 25, 30, 35, 40, 45, 50, 60, 70, 80, 90, 100,112, 125, 150, 175, 200, 225, 250, 300, 350, 400, 450, 500, 600, 700,800, 900, 1000 milliseconds (ms).

The parameter regulation module 229 also determines whether particularparameters can or can not be set in response to voice commands based onthe current parameter information. For example, the parameter regulationmodule 229 might determine that the interval setting was set to “OFF”,or that no interval parameter value was initially provided, andautomatically ignore voice commands for the interval parameter in orderto prevent the interval parameter from being accidentally set. In thisway, the module 229 applies a safety policy that prevents the operatorfrom changing the parameters in a way that could be detrimental topatient health.

In the illustrated example, the voice control module 228, microphone234, speakers 236, GUI 232 rendered on the touchscreen display 230, andthe activation device 106 provide a general user interface (UI) for theLIO system 100. However, in other embodiments (not illustrated) the UIfor the LIO system 100 can also include other user interface elements237 such as physical input mechanisms such as knobs or buttons, whichcan be part of the mobile computing device 104 itself or part ofperipheral devices connected to the mobile computing device 104 via thewireless interface 220 and/or a physical interface (e.g. data port). Ingeneral, the parameter information can be generated by the mobilecomputing device 104 based on any user engagement with the mobilecomputing device 104 and/or peripheral devices.

The wireless network interface 220 facilitates sending the parameterinformation to the control module 108 via the antenna 218 through awireless communication link with the control module 108 according towireless personal area network (WPAN) or wireless local area network(WLAN) protocols such as Bluetooth Low Energy (BLE) or WiFi, among otherexamples.

The headset 102-1, as previously discussed, includes the control module108, the power module 110, the laser module 112, the binocular indirectophthalmoscope 120 and the illumination unit 114.

The power module 110 includes a battery 210, which supplies the powerprovided to the control module 108, laser module 112 and illuminationunit 114. Among other functions, the power module 110 performs thefunctions of a battery management system (e.g. preventing the batteryfrom operating outside its Safe Operating Area, monitoring its state,etc.).

The laser module 112 includes a fiber optic cable 206 for emitting thelaser energy. The fiber optic cable 206 is routed through the binocularindirect ophthalmoscope 120 such that the laser energy is emitted fromthe exit aperture 116.

The control module 108 includes a CPU 202 and a wireless interface 204.The CPU 202 directs the functionality of the control module 108 such asreceiving parameter information from the mobile computing device 104 andactivation signals from the activation device 106 via the wirelessinterface 204 and an antenna 212, as well as sending control signals tothe laser module 112.

Finally, the activation device 106 includes a wireless interface 214 andan antenna 216 through which activation signals are sent to the controlmodule 108. In another embodiment of the body-mounted LIO system 100-1(not illustrated), the activation device 106 is a wired foot switch witha wired interface through which activations are sent to the controlmodule 108.

In some embodiments, the voice control module also performs thefunctions of user interface associated with the activation device. Forexample, in response to a voice command such as “execute”, the devicecould activate the laser.

FIG. 3 is an illustration of a table-top LIO system 100-2 to which thepresent invention is applicable.

The table-top LIO system 100-2 includes a laser console 103 and aheadset 102-2. The headset 102-2 includes the binocular indirectophthalmoscope 120 and the illumination unit 114 as before. Now,however, the laser console receives the user input via a user interfaceof the laser console 103, which can include a graphical user interface232, or other input and display elements such as knobs, dials, keypadsand/or buttons generates the parameter information, and drives the laservia a longer fiber optic cable 206 which is routed to the laser console103. The laser console 103 receives input from the activation device 106via a wired connection.

FIG. 4 is a schematic diagram of the table-top LIO system 100-2. Here,the laser console 103 includes the control module 108, the power module110 and the laser module 112. Additionally, the activation device 106includes a wired interface 240, and likewise the control module 108includes a wired interface 238. Instead of sending the activationsignals wirelessly to the control module 108, the activation device 106sends the signals via a wired connection between the two devices.

Additionally, the laser console 103 now includes the microphone 234 andthe speakers 236. The laser console 103 receives the user input via thegraphical user interface 232 and/or an additional physical userinterface 237, which can include input and display elements such asknobs, dials, keypads and/or buttons.

The control module 108, as before, sets the parameters for the deliveredlaser energy based on parameter information. Now, additionally, thevoice control module 228 and the parameter regulation module 229 executeon the CPU 202 of the control module 108.

FIG. 5 schematically shows a slit lamp device 101 to which the presentinvention is applicable. The figure schematically shows the previouslydescribed laser module 112-a that produces the pulsed laser energy andthat is attached to the slit lamp 101 via a tonometer mount. The slitlamp includes a magnifying optical device 531, such as a microscope orzoom telescope, configured to receive light at a viewing input 532 alonga viewing path 503 from a target area. The central part of the slit lamp101 includes a white light source 501 that is used to illuminate atarget area in the eye 502 of the patient. This white light is directed,by means of a mirror 504, onto an illumination output path 511 thatcoincides with the optical viewing path 503 of the operator at thedesigned focal point of the diagnostic instrument at the target area. Inthe same fashion, the light 505 from the laser is directed towards thetarget area along a treatment beam path such that it coincides with theviewing path, at least at the target area.

FIG. 6 is a schematic diagram of the slit lamp device 101. The slit lampdevice 101 comprises a diagnostic instrument 906 and an adapter unit112-a mounted to the diagnostic instrument 906.

The system further comprises a user terminal 951 in wirelesscommunication with the adapter unit 112-a, and the power module 110electrically coupled to the adapter unit 112-a.

In the illustrated embodiment, the power module 110 provides DCoperating power to the adapter unit 112-a and the user terminal 951provides the user interface 237 to the operator and communicates controlcommands to the adapter unit 112-a. The power module 110 may bebattery-powered or configured to receive external power, e.g. AC power.The power module 110 may also be integrated into or directly attached tothe housing of the adapter unit 112-a; for example, the adapter unit112-a may comprise a replaceable, e.g. rechargeable, battery. The userterminal 951 may further receive values of operational parameters suchas performance parameters from the adapter unit. The power module 110and the user terminal 951 may be embodied as separate units or as asingle control unit. The user terminal 951 provides a voice interfaceallowing for a hands-free control of performance parameters of theadapter unit 112-a. To this end, the user terminal 951 includes themicrophone 234, and speakers 236 and the voice control module 228 andparameter regulation module 229 execution on the CPU 202. Preferably,the voice recognition system is a self-contained system that operateswithout the need to communicate with a remote host. However, inalternative embodiments, the voice recognition system may be adistributed system where at least a part of the voice recognitionprocess is performed by a remote host system. Alternatively oradditionally, the user terminal may comprise one or more other userinterface devices 237, such as knobs, switches, a display, a touchscreen and/or the like. The user terminal may further comprise, or becoupled to, the activation device 106.

The diagnostic instrument comprises a power supply 959, a control unit957 and an operating console 958, e.g. embodied as separate units or asa single, integrated unit. The user terminal 951 for controlling theadapter unit 112-a may be integrated into or separate from the operatingconsole of the diagnostic instrument. Similarly, the power supply unit952 and the power supply unit 959 may be embodied as separate units oras a single, integrated power supply.

FIG. 7 is a sequence diagram illustrating the process by which theparameters for delivered laser energy are set based on the capturedaudio data.

First, in step 800, the control module 108 sets initial parameters forthe laser energy delivered by the laser module 112 based on the lastused parameters, input detected via the GUI 232 or user interface 237,or predetermined default parameters.

In step 802, the activation device 106 detects engagement of theactivation mechanism. In one example, the user's foot compresses afootswitch. In response, in step 804, the activation device 106 sends anactivation signal to the control module 108.

In response to receiving the activation signal, the control module 108in step 806 sends a control signal to the laser module 112.

In step 808, in response to receiving the control signal, the lasermodule 112 generates and emits the laser energy according to theparameters set by the control module 108.

In step 809, the voice control module 228 detects activation of a voicecontrol mode based on configuration information and/or the predeterminedsafety policy which might specify situations in which voice controlshould be selectively executed.

In step 810, the voice control module 228 receives captured audio data.In one example, the mobile computing device 104, the laser console 103or the user terminal 951, which continuously and in real time monitorsaudio data captured via the microphone 234 for a predetermined wake wordprogrammed, detects the wake word and, in response, plays a tone throughthe speakers 236 prompting the user to say the voice command. The voicecontrol module 228 then generates audio data based on sound that wascaptured after the wake word was detected and tone was played and sendsthe audio data to the voice control module 228.

In step 812, the voice control module 228 generates voice commandinformation based on the captured audio data. In one example, the audiodata includes spoken language such as the phrase “power up”. The voicecontrol module 228, for example via speech recognition processes,recognizes the phrase “power up” and translates the phrase intoparameter information indicating that the power parameter should beincremented. The voice control module 228 sends the voice commandinformation to the parameter regulation module 229 in step 812.

In step 229, the parameter regulation module 229 generates parameterinformation based on the voice command information, the currentparameters, and/or the predetermined safety policy. In one example, theparameter regulation module 229 increases or decreases the currentparameter value by a predetermined threshold and generates parameterinformation reflecting the higher or lower value. In another example,the parameter regulation module 229 selects the next highest or lowestvalue with respect to the current value from a predetermined sequence ofpossible parameter values. In another example, the parameter regulationmodule 229 determines whether setting of the particular parametersindicated in the voice command information should be allowed based on,for example, whether voice control of particular parameters isselectively executed.

In step 818, the parameter regulation module 229 sends the parameterinformation and instructions to set the required parameters to thecontrol module 108.

Steps 802 through 808 then repeat as previously described, with thelaser module 112 delivering laser energy based on the parameters.

FIG. 8 is a flow diagram illustrating the process by which the parameterregulation module 229 generates parameter information based on the voicecommand information and the predetermined safety policy, whichcorresponds to the previously described step 816, for example.

In step 900, the parameter regulation module 229 receives the voicecommand information from the voice control module 228.

In step 902, the parameter regulation module 229 provides audiblefeedback repeating the voice command information (e.g. via the speakers236) and prompts the user to confirm that the voice command informationgenerated by the voice control module 228 and received from theparameter regulation module 229 accurately reflects the voice commandsspoken by the user.

In step 904, it is determined whether a positive confirmation wasreceived from the user (e.g. based on the voice control module 228detecting a predetermined confirmation word via the microphone 234). Ifconfirmation was not received after a predetermined time period, theprocess ends in step 930, and the parameter regulation module 229 doesnot proceed to change the parameters. In an alternative embodiment, theparameter regulation module 229 does not perform the confirmation ofstep 904 and simply proceeds after providing the audible feedback.

On the other hand, if confirmation was received within the predeterminedtime period, in step 906, the parameter regulation module 229 identifiesthe particular parameter (e.g. power, duration, interval, aiming beam,pulse duration, pulse interval) to be set or adjusted based on the voicecommand information. The parameter to be set/adjusted is based on, forexample, which of a predetermined set of words associated with theparameters was detected and recognized by the voice control module 228.

Similarly, in step 908, the parameter regulation module 229 thenidentifies whether the parameter value is being set directly (e.g. basedon recognized phrases corresponding to numerical values such as “200”)or incrementally (e.g. based on recognized phrases corresponding towhether the value should be increased or decreased such as “up” or“down”).

In step 910, it is determined whether the parameter is being setincrementally. If not, in step 918, the parameter regulation module 229generates the parameter information based on the parameter being set andthe value indicated by the voice command information.

On the other hand, if the parameter is being set incrementally,conditions such as the currently set parameters are evaluated todetermine whether voice control should be selectively executed orwhether the voice command should be ignored. For example, in step 912,it is determined whether the interval is the parameter being set, and ifso, in step 914, it is determined whether the current setting for theinterval parameter is “OFF” (or some other indication that an initialvalue for the interval has not been provided). If the interval parameteris set to “OFF”, no change is made, the voice command is ignored, andthe process ends in step 930.

On the other hand, if the interval is “ON” and is being adjusted, or ifsome other parameter value is being set or adjusted incrementally, instep 916, the parameter regulation module 229 retrieves or calculates avalue for the parameter based on the predetermined safety policy. In oneexample, the policy sets a maximum increase or decrease value orpercentage by which the current value is adjusted to calculate the newvalue. In another example, the policy provides a predetermined sequenceof allowed values according to which the current value is incremented ordecremented to the next value in the sequence. The parameter regulationmodule 229 then generates the parameter information.

Whether the parameter was set directly or incrementally, in step 920,the parameter regulation module 229 evaluates the parameter informationbased on the predetermined safety policy (for example, based onpredetermined criteria in the safety policy for determining whenparameters are potentially unsafe). This might include confirming that aparameter value set directly is within a certain difference threshold ofthe current value or that the value is within a predetermined range,among other examples.

In step 922 it is determined whether the parameters, including theparameter currently being set combined with the other parameters, createa potentially unsafe situation for the patient. If so, in step 924, theparameter regulation module 229 provides audible feedback repeating thegenerated parameter information (e.g. via the speakers 236) and promptsthe user to confirm the parameter being set, possibly with a messageinforming the user that the parameters are potentially unsafe. In step926, if no confirmation is received within a predetermined time period,no parameter changes are made, and the process ends in step 930.

On the other hand, if the parameters are not determined to bepotentially unsafe, or if the user confirms the potentially unsafeparameters within the predetermined time period, in step 928, theparameter regulation module 229 sends the parameter information to thecontrol module 108, which corresponds to previously described step 818.

Finally, the process ends in step 930. However, the process repeatscontinually, as the voice control module 228 continually generates voicecommand information based on audio data from the microphone 229 andsends the voice control information to the parameter regulation module229.

Voice Command Examples

In general, the following table includes a set of exemplary voicecommands interpreted by the voice command module 228, along with theappropriate action taken in response to the voice commands by theparameter regulation module 229. For these examples, the value Nrepresents the current parameters, “N+1” and “N−1” are understood todenote the value N incremented or decremented, respectively, accordingto the safety policy. Similarly, the word “[TONE]” in the “Full CommandSet” column indicates where in the sequence of spoken voice commands anaudible tone would be played through the speakers 236 (e.g. a soundresembling a beep, chime) to prompt the user to proceed to say the restof the voice command. The word “[MODE]” in the Audible Response columnindicates where in the phrase a word corresponding to the current modeof the laser treatment system 100, such as “Treat” mode or “Standby”mode, among other examples.

More specifically, the Command column includes different voice commands(e.g. phrases spoken by the user) which are recognized by the voicecontrol module 228. The Full Command Set column includes full sequencesof wake words, audible tone prompts, and voice commands. The AudibleResponse column includes audible feedback (e.g. phrases) played throughthe speakers 236 in response to the voice control module 228 recognizingand interpreting the voice commands. Finally, the System Action columnincludes actions performed, for example, by the parameter regulationmodule 229 in response to the voice control module 228 recognizing thevoice commands in the Commands column.

Command Full Command Set Audible Response System Action “Enter Treat”“OK Norlase” “Treat Mode Selected” Places the system [TONE] into a“Treat” Mode “Enter Treat” “Enter Standby” “OK Norlase” “Standby ModeSelected” Places the system [TONE] into the “Standby” “Enter Standby”Mode “Power Up” “OK Norlase” “Power at [N + 1]” Increases power [TONE]one increment from “Power Up” current setting “Power Down” “OK Norlase”“Power at [N − 1]” Decreases power [TONE] one increment from “PowerDown” current setting “Duration Up” “OK Norlase” “Duration at [N + 1]”Increases Duration [TONE] one increment from “Duration Up” currentsetting “Duration Down” “OK Norlase” “Duration at [N − 1]” DecreasesDuration [TONE] one increment from “Duration Down” current setting“Interval Up” “OK Norlase” “Interval at [N + 1]” Increases Interval[TONE] one increment from “Interval Up” current setting “Interval Down”“OK Norlase” “Interval at [N − 1]” Decreases Interval [TONE] oneincrement from “Interval Down” current setting “Aiming Beam Up” “OKNorlase” “Aiming Beam at [N + 1]%” Increases aiming [TONE] beam 10%“Aiming Beam Up” “Aiming Beam Down” “OK Norlase” “Aiming Beam at [N −1]%” Decreases aiming [TONE] beam 10% “Aiming Beam Down” “Pulse Count”“OK Norlase” “Pulse Count at N” Will call out the [TONE] current numberof “Pulse Count” laser pulses delivered “System Status” “OK Norlase”“[Mode] Mode selected, Will call out the [TONE] Power at [N], currentsettings “System Status” Duration at [N], for Laser Status, Interval at[N], Power, Duration, Pulse Count at [N]” Interval and Pulse Count.

In one example, in order to execute the “Enter Treat” voice command, theuser speaks the wake word “OK Norlase.” An audible tone is then playedthrough the speakers 236, after which the user speaks the voice command“Enter Treat.” In response to the voice control module 228 recognizingand interpreting the voice command, the parameter regulation module 229plays the audible feedback phrase “Treat Mode Selected” and thenproceeds to place the system into the “Treat” mode, during whichparameters can be adjusted and laser energy can be delivered.

In another example, in order to execute the “Power Up” voice command,the user speaks the wake word “OK Norlase.” An audible tone is thenplayed through the speakers 236, after which the user speaks the voicecommand “Power Up.” In response to the voice control module 228recognizing and interpreting the voice command, the parameter regulationmodule 229 plays the audible feedback phrase “Power at [N+1]”, referringto the new value of the power parameter and increases the power oneincrement from the current setting, according to the safety policy andother processes described, for example, with respect to FIG. 8. Forexample, if the power is currently set at 120, the audible responsewould be “Power at 130” to indicate that the power parameter has beenincreased to 130.

Finally, in yet another example, in order to execute the “System Status”voice command, the user speaks the wake word “OK Norlase.” An audibletone is then played through the speakers 236, after which the userspeaks the voice command “System Status.” In response to the voicecontrol module 228 recognizing and interpreting the voice command, theparameter regulation module 229 plays the informational audible feedbackphrase “[Mode] Mode selected, Power at [N], Duration at [N], Interval at[N], Pulse Count at [N],” referring respectively to the current modesetting and the current values of the power, duration, interval andpulse count.

While this invention has been particularly shown and described withreferences to preferred embodiments thereof, it will be understood bythose skilled in the art that various changes in form and details may bemade therein without departing from the scope of the inventionencompassed by the appended claims.

What is claimed is:
 1. A system for delivering laser energy to an eye ofa patient, the system comprising: a microphone for capturing audio data;a voice control module for receiving the captured audio data andgenerating voice command information based on the captured audio data,wherein the voice control module generates the voice command informationby recognizing spoken language indicating 1) whether a pulse durationshould be incrementally increased or decreased; and 2) whether a powerlevel should be incrementally increased or decreased; a parameterregulation module for generating parameter information based on thevoice command information; a control module for receiving the parameterinformation and setting the parameters for the delivered laser energybased on the parameter information; a speaker for providing audiblefeedback confirming the voice command information; and a footswitchactivation device for activating the delivery of the laser energy. 2.The system as claimed in claim 1, wherein the voice control modulegenerates the voice control information by recognizing spoken languageindicating values for the parameters.
 3. The system as claimed in claim1, wherein the microphone captures the audio data in response todetecting a predetermined wake word.
 4. The system as claimed in claim1, wherein the voice control module executes on a mobile computingdevice of a body-mounted laser-indirect ophthalmoscope system, a laserconsole of a laser-indirect ophthalmoscope system, and/or a userterminal of an ophthalmic laser treatment system.
 5. The system asclaimed in claim 1, wherein the parameter regulation module executes ona mobile computing device of a body-mounted laser-indirectophthalmoscope system, a laser console of a laser-indirectophthalmoscope system, and/or a user terminal of an ophthalmic lasertreatment system.
 6. The system as claimed in claim 1, wherein theparameter regulation module generates the parameter information based oncurrent values for the parameters to be set and/or a predeterminedsafety policy.
 7. The system as claimed in claim 6, wherein the safetypolicy indicates maximum values and/or percentages by which the currentvalues for the parameters can be increased and/or decreased to calculatenew values for the parameters.
 8. The system as claimed in claim 6,wherein safety policy indicates predetermined sequences of possiblevalues for the parameters.
 9. The system as claimed in claim 1, whereinthe safety policy indicates whether particular parameters should beselectively executed based on current parameters.
 10. The system asclaimed in claim 1, wherein the voice control module generates the voicecommand information based on voice recognition processes executedlocally and/or on a remote host system.
 11. A method for deliveringlaser energy to an eye of a patient using an ophthalmic laser treatmentsystem, the method comprising: capturing audio data; generating voicecommand information based on the captured audio data by recognizingspoken language indicating 1) whether a pulse duration should beincrementally increased or decreased; and 2) whether a power levelshould be incrementally increased or decreased; generating parameterinformation based on the voice command information; setting parametersfor the delivered laser energy based on the parameter information;providing audible feedback confirming the voice command information; andenabling activation of the delivery of the laser energy via a footswitchactivation.
 12. The method as claimed in claim 11, further comprisinggenerating the voice command information by recognizing spoken languageindicating values for the parameters.
 13. The method as claimed in claim11, further comprising capturing the audio data in response to detectinga predetermined wake word.
 14. The method as claimed in claim 11,wherein the ophthalmic laser treatment system is a body-mountedlaser-indirect ophthalmoscope system, a laser console of alaser-indirect ophthalmoscope system, and/or a user terminal of anophthalmic laser treatment system.
 15. The method as claimed in claim11, further comprising generating the parameter information based oncurrent values for the parameters to be set and/or a predeterminedsafety policy.
 16. The method as claimed in claim 15, wherein the safetypolicy indicates maximum values and/or percentages by which the currentvalues for the parameters can be increased and/or decreased to calculatenew values for the parameters.
 17. The method as claimed in claim 15,wherein the safety policy indicates predetermined sequences of possiblevalues for the parameters.
 18. The method as claimed in claim 15,wherein the safety policy indicates whether particular parameters shouldbe selectively executed based on current parameters.
 19. The system asclaimed in claim 1, wherein the voice control module generates the voicecommand information by recognizing spoken language indicating whetherthe system should be placed in a standby mode or placed in a treat mode.20. The system as claimed in claim 1, wherein the voice control modulegenerates the voice command information by recognizing spoken languageindicating whether increasing or decreasing an aiming beam.
 21. Thesystem as claimed in claim 1, wherein the voice control module generatesthe voice command information by recognizing spoken language indicatinga number of pulses to be delivered.
 22. The system as claimed in claim1, wherein the audible feedback includes repeating back the voicecommand information.
 23. The system of claim 1, wherein valid voicecommands for pulse duration and power level parameters are limited towhether to adjust the parameters up or down.
 24. The system of claim 7,wherein the safety policy sets a predetermined maximum percentage forincreasing or decreasing the current values, and the parameterregulation module only increases the pulse duration and the power levelby the predetermined maximum percentage based on the voice commandinformation.
 25. The system of claim 23, wherein the predeterminedmaximum percentage is 20%.
 26. The system of claim 1, wherein theparameter regulation module evaluates safety of the generated parameterinformation based on predetermined safety criteria in the safety policyand provides audible feedback informing a user of potentially unsafeparameters.
 27. The system of claim 26, wherein the audible feedbackinforming the user of potentially unsafe parameters includes a messageinforming the user that the parameters are potentially unsafe.
 28. Thesystem of claim 2, wherein the parameter regulation module evaluates thesafety of parameter values that were set directly via the spokenlanguage indicating the values for the parameters by confirming that theparameter values that were set directly are within a certain differencethreshold of current parameter values and/or that the parameter valuesthat were set directly are within a predetermined range.
 29. The systemof claim 1, wherein the parameter regulation module determines whetherparameter values being set via the voice command information combinedwith other parameters create a potentially unsafe situation.
 30. Thesystem of claim 29, wherein the parameter regulation module prompts auser to confirm parameter changes indicated by the voice commandinformation in response to determining that the parameter values beingset via the voice command information combined with other parameterscreate a potentially unsafe situation, and the parameter regulationmodule makes no changes to current parameters in response to determiningthat positive confirmation was not received within a predetermined timeperiod.
 31. The system of claim 1, wherein the parameter regulationmodule prompts the user for extra confirmation of the voice commandinformation in response to determining that parameters indicated by thevoice command information are potentially unsafe according to the safetypolicy.
 32. The system of claim 9, wherein the parameter regulationmodule generates the parameter information based on the safety policyindicating whether particular parameters should be selectively executedbased on current parameters by, upon determining that the voice commandinformation indicates an adjustment to an interval parameter, ignoringthe voice command information in response to determining that an initialvalue for the interval parameter was not previously provided for acurrent treatment session.
 33. The system of claim 8, wherein theparameter regulation module generates the parameter information based onthe safety policy by incrementing or decrementing the current values forthe parameters to the next values in the predetermined sequences ofpossible values indicated by the safety policy.
 34. A system fordelivering laser energy to an eye of a patient, the system comprising: amicrophone for capturing audio data; a voice control module forreceiving the captured audio data and generating voice commandinformation based on the captured audio data, wherein the voice controlmodule generates the voice command information by recognizing spokenlanguage indicating 1) whether a pulse duration should be incrementallyincreased or decreased; and 2) whether a power level should beincrementally increased or decreased; a parameter regulation module forgenerating parameter information, based on the voice commandinformation, current values for the parameters to be set, and apredetermined safety policy, by iterating through sequences ofpredetermined values indicated by the safety policy for particularparameters and selecting the next higher or lower values in thepredetermined sequences with respect to the current values, or bycalculating adjusted values for the parameters by increasing ordecreasing the current values for the parameters by predeterminedmaximum values and/or percentages indicated by the safety policy for theparameters; a control module for receiving the parameter information andsetting the parameters for the delivered laser energy based on theparameter information; and a footswitch activation device for activatingthe delivery of the laser energy based on the parameters set by thecontrol module.